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^ ' • The philosophy ■ae4>artment of tJie Ohio State 

University b^gatn. development of a computer-tutorial program, cabled 
ENTGIJA, in 1972* The aim of th^ course vas to help students to u&e 
various^ ;logioal tools in the analysis of everyday arguments giving 
drill-^ead-practice sessions^ testing, and grading examinat^ns4. Part 
of ENIGMA is the proposit£onal atgumeftt program vHich is ablest o 
abstract the relevant synitactical form from the Student* s natural 
Ip^nguage response and checl^ the response for logical mistakes, gross 
spelling erro'^s, and viglations of propositional integrity* This 
proiftiaa can be used in a test as veil as a tutorial formats *A program 
{or categorical syllogisms has a_feature^ offering the capability of 
using Venn diagrams to determine validity* The programing language 
for^ EKIGSa i'S Coutsewriter II; it is^ timeshared on an IBM 370/158*^ It 
is expected %hat by sprang of 1976 appr6ximately 1,X)00 students per 
quarter Mill use the program, fJY) - . ^ ' 



Documents acquired by EBIC include many informal unpublished 
materials not available from other sources* EBIC malces every, effort 
to obtain the best copy available* nevertheless, itevs of marginal 
reprojAucibilit-y are often encountered and this affects the quality 
of the* microfiche *and hardcopy reproductions EBIC makes available 

* via the EBIC Document Beprodttction Service (EDBS) * EDBS is not ^ 

* respdnsible for* the quality of the original document* Beproductions 

* supplied by . EDBS are the best t\at can be mad^ from the ""original* 
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I ntroduction • ^ 

■! 

1-n an effort to iroprpve and personalize the instruction of introductory logic * 
courses/ the Philosophy Peparlftnent of The Ohio State University commenced the, 
development of a computer-tutorial program, ENfGMA, in the spring'of 1972, The 
programming software is nearly complete^^ and full implementation, for approxi^ 
mately one thousand students, per quarter, is scheduled for spring 1976, The 
'programming language is IBM^ s Coursewriter 111/ version 3 ks augmented by the 
Ohio State set of functions; the syst;em^timesliares on an IBM 370/156; When in 
fulL operation the program vill utilize thirty^-bne Hazeltine 200Q terminals^I 
Average student time' on the, terminals will be one and a half hours per week, 

T^e general aim of the introductory logic -course is- to impart to the studeat the 
ability to use various logical tool^ in' the analysis of everyday arguments. The 
orientation of the course is not toward the type'^of symbol manipulation appro- 
priate to mathematical logic. The computer will be use4 to provide tutorial/ 
i.e, , supervis.ed drill and practice, for students who will have already been 
'exposed/ vi^a lectures and reading/ to the course material. In ' addition ) to super^ 
vising students' drill and practice, the computer will refer students with per-/ 
sistent difficulties to l>ve teaching staff, finally, the computer w£^l adminis- 
ter and* grade, the course examinations- " 

The content of the course includes both deductive and inductive logic. Some of 
its distinguishing featured are; its, ability/ in certain lessons/ to accept sets 
of English sentences as the appropriate student response; its a):^ility .to randomly 
generate. and solve problems; -its use of computer graphic^s, and finally/ its 
^extended managerial capabilities^ 

A basic gdal of ^ the coutse is to.^nable students to? 

(1) rewrite ordinary English arguments/ or purported arguments into the appro- 
priate logically standard English form/ where this standard torm will reflect* 
the r-elevant logical properties <if the given argument,^ ^ 

(2) * abstract from this standard ^glish form the essential symbolic or syntactic 
form of the argument 

.(3) evaluate the abstracted form for validity (or in the case of inductive 
arguments lor strength of inductive support) 

Given this basic goal, it was determined that at leasit some of 'the computer 
tutorials ^should be .capable of accepting and adequately analyzing . sets of 
English^ sentences as the normal student response. 
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I will now describe our prepositional argument program , Si^nilar oa^o^rams exist 
or are in tihe . developmental stage i^or categorical arguments of ^syllogistic form 
Sl^ well as for more general but simple .arguments of quan1;if icat^onal form. From 
the^ point of view of ordinary predicate calculus (the normally used canonicaT 
form) the most ^asic argument-' forms are 'propo^it^ional ; i^e^^the logical proper- 
ties depend on the wa^^ the component ^ntences are conna^Cxed and not on tlieir 

.internal structure. These argiim&nt fornvs also provide natural starting place _ 
for 'the e(3wcational process. (There are, of course, >^veral important qualif i^ \ 

*cations to be made here, but this is not the appropriate ^lace,) 

The proposltional argument program begins, for/the student, by presenting (in 
.ordinary English) a text of a propo&itionaly^gument vitli one conditional and 
one non-coitditional premise, 'For example 



Socrates didn' t accept the benefits' of the s*ta,te< thus he ^ou'ldn't 
iibey the law, because he should obey t'he law only' if he had accented ^ 
those ^Denefits, / /' 

^ . - ' ; ■ ' 

Thq' immediate student t^sk is to; 

(1) distingui'sh premises from conclusion 

(2) ..translate'all conditionals into a ^aridard if-then tform 

(3) elimi:l:iate. premise and conclusion marker^ ^uch .as ^ because, ' 'since,' 'hence,' 
and 'therefore' ' ^ 

(4) eliminate logically irrelevant expressions such as those ot emphasis 

The student -^^istingui^es the^ premises from the conclusidn b^^ entering a three 
line response, with the* ^remi;^s as , the first two linep, and tha conclusion as 
the las€ line^ (It is not necessarj^ that tb& student put the conditional. pVemise 
first,) ' ' ' ' / ^ 



Af jter* the student completes his' three line response, the program begins its - 
analysis by checking for some elementary ^nd easily spotted mistakes, . These 
fall into three categories; ' ' '"^ , ' 

(1) Minor errors such as the omission of 'then'^ from 'if-then' statements; the 
failure to eliiiiinate conclusion and premise markers, ^ ^ 

of the conditional premise into an 'if-then' form^ 
:>2e or iterated negation 



(2) Non** trails l^atioi 

(3) The use of do| 



Mistakes of the t|pe 
is not fo^^ced to 
answer ei^sentially 
type (2) , / sinc^ the' 
be^ properly transl 



(1) are reported by ENIGMA to tHe student, but the student 
rite his answer since he may ^tiJLl haV& the logic of his 
rrect. Students, though, inust rewrite mista)jes of the 
mistakes signify that conditional statements have not 
ed into standard if-then form. Students are also asked 
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to eliminate .type (3)\tlstakes, itercited negations. 



Originally it was also required that students repjLace tfll pronouns with their 
antecedents^; later this Requirement was softened po that ENIGMA only mentioned 
such lapses. Our experience withthe program has led to the more radical modifi- 
cation that we now encourage students .to use pronouns, 'This move is natural and 
saves typing time, EaJlGMA will require the substitution of antecedents only in 
those cases v^ere ambiguity results or wh^re ai) improper pronoun has becfn used. 
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ENIGMA wijM. next abstract the relevant syntactical form f roin the student res- 
ponse. If this abstraction were not mad^/ all the possible errors and correct 
answers f ir ^each text^woiild have to be separately generated and stored. Since, - 
however/ we need only check for syntactic or logical features/ it does not matter 
if the semantic content specif ic,t(^ each individual text is lost -via the process 
of abstrattion, , . 

I T 

I hh ' * 

■ , 

The abstraction program identifies the subjects/ verbs/ and objects of €he°pro- 
positional components' of the' studept' s answer. The program will tolerate, 
examplesjthat h^ve prepositional components with the same or diffejrent veifbs'/ ,the 
same or different Qbjects/ and iJith the same/ different/ or" no objects. In 
addition! account has TDeen. taken of the relevant syntactical differences between 
sentences with transitive versus copulative verbs. Finally, variations of English 
tense sti:uctur& are handled by scanning only for verb roots (unless l^ically 
importarlt tnodalities are expressed with helping verbs),/ ' ^ * ' * 

The proqraiTvming necessary for the-text spebific part of tlie abstraction can be 
entered ^by means of ^ne' of ENIGMA'S macros, All that needs to be entered is an 
ordered jlist of subjects/ ve]^bs and oBjects ^ith the usual Coursewriter ^pd 
■** symliols to indicate acceptable misspellijags, We have eit Ohio State developed 
a modified function edit routine that will accept these symbols. 

Once the student's- rosponse is symbolized, two sorts of mjlstakes are checked for: 
a) "Gross^ spelling mistakes; b) Violations of prepositional integrity, 

ai The s^^ribolizing part of the program is designed to recognize typical mife- 
spellingb. For examiplei "Socratis"/ "Socrate", "Socrats*' ^11 count as VSocrates", 
Should tfte student/ howeyer/ make a spelling error not ordinarily picked xtp in 
our prognam/ this "gross" misspelling is located by the programming immediately ■ 
following! tha abstraction section. The student- is informed, of , the location of 
his spelling error and is Basked to correct it,. (Wijih the ckthode ray tubeV . 
terminal Ihe student nebd not retype bis entire answer but can selectively correct 
only thatVpart which has been misspelled,) This part of the progrJon will also^ 
pick out apd locate radical substitutions for correct answers. For exaifiple/ 
substituti^^g "Plato" for "Socrates", . ^ 

.... • ' t 

,) '^Violations of ^prepositional integrity" re^era to the mixing of the parts of 

the proposiAiorial components of the argument so that those com|»onent proposi- » 

tions lose their identity. An example of such a "violation" would be witing: • 

\ - ■ ■ 

* If ^ohn quit Martha/ then John loves politics/ 
instead of 

If John loves Martha/ then John <juit politics. 



Mistakes of both types^ (a) and (b) will usua^ly'be either mere slips on the 
Vs^udent's part of deliberate ^atten^t^s to "beat." ^the computer program. In either 
case the student ^s given a computer response specific to thte error (along with, 
in some ba^es/ . a note on the difficulty of determiiting student motives). 

Finally/ tlj^ computer^ checks the student's answer for any logical mistakes. 
(This forms the core ^f the prepositional j^dgram,). Logical mistakes, for the 
purposes of this tutorial/ are (1) confusing premises 'and conclusion; and (2) 
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confining negations* or converses for correct answers* In additioqi the fjuroper 
ordering and ntiniber of negations is is checked for in th^-condltional prejnnises* 
(The program/' incidentally is not confused by ^the substitution of contra- . < 
positives/ i*e,/ writing a statement of , the f*orTii *if not-q, then not-p*, instead 
of its logical equivalent, t if p, then q**y ^Comments' appropriate to eacfy of , 
these mistakes are given to the students* Persistent confusion on the student's 
part branches him to remedial section pr off the terminal tb "live" instructional 
staff. , . 

The ENIGMA prepositional argument program has some additional features, 

(1) If the student makes a serious logical mistake he is, ^fter he has ^ 
gotten it correct or had it corrected/ given the option of rewriting his 
answer for succeeding lines, *' 

(2) If the studtiint cannot provide'the correct answer, he may after V miinimum • ^ 
number of tries opt for EN;IGMA tq supply the correct answer, ENIGMA need not 

told the correct angj^er^ by instructors. All that needs to be, entered via 
the appropriate macro is an ordered set of' subjects/ verbs and objects, PNIGMA 
will always ^pply thfe student'^fcfth the correct answer for any of the possible 
32 prepositional argument forms instantiate by the given text, (More on the 
^process of text and problens entry is given below,) ^ ^ , 

After the student successfully completes -his rewrite of the given text into % 
logically standard English, form he is asked *to symbolize answer as prepositional 
argument. For example: 

If not p then q • * 

q 

not p 

(Note: TIt^s symbolizfition differs from that used ^y ENIGMA to recognize student 
response, EtTIGMA*s abstraction program breaks student responses down to the 
parts/ i,e,/ subjects, verbs/ objects/ negations, of the component propositions,) 

Should the etudent make a mistake here/ ENIGMA will supply the, correct answer 
along with the proper substitution for the variable letters used. 

The anticipated correct symbolic fonii is automatically adjusted by ENIGMA *to 
be a function of the student's standard English response. Thus if the contta- 
positivei for exan\ple*^ is entered, the correct symtoolijc form is adjusted 
accordingly, ENIGMA wi!l.l also recognize 'ellminable occurrences of *no^^, * 
ENIGMA will accept their explicit mention by students but wiil remind students 
of 'the existence of either simpler or more familiar forms. 

Finally, the student is asked to determine the validity of the argument fonii, 
With respect to these simple propositional forms' this process is primarily one 
6f recpgnition, - - . 



Entering a P^pbJLem Tdjct 
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^Entry by an ENIGMA user of a new problem text occurs in essentially tWio steps, 
Fir3t/ one must enter in an ENIGMA macro the subjects/ verbs and object© (if 
they exist) of the component propositions. The misspelling code is also to be 
entered here. Second/ one can now enter up to 32 variations of propositional 
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arguments that are cojistructible from the given ordered components, All that 
4ieeds to be done is to enter the ordinary English text along with a. six digit 
code, . \ ' ^ ^ ' 

(Fbr any two different statements p and q# there exist 128 different proposi- 
tional arguments with one conditional premise^ one non-conditional premise^ and 
a non-^conditional ^conclusion, <There are fight possibilities for the condi- 
tional premise* if p then q# if not p then not g# if p then not q* if not p 
.then q* plus their conv<ir^si four possibilities for the non-conditional premise* 
Pt not q# <if not p/ and those same four possibilities for the conclusion,) If 

»,the argument' fonn^ are restricted so as not to include prox>ositional functions 
{i,e.# negation and not iv^gation) of the same proposition as both non-conditional 
premise and conclusion* the number of variations reduce^ to 64- Further res" 
triction of these forms to the classic modus ■ m onehs * modus tollens» and the 
^t^llacies of affirming the consequent and denying the antecedent* reduces this 

^ ^number ta 32, Finally* if the conditiqp^ premise indicates* for example^ a 
causal connection/ the number is reduced to around 16, Now while only these 
last two sets of 32 and 16 are usled in the tutorial* the program as it* nqy 
stands can be u'led for all 128 variations- This enornious extra flexibility means 
that the program can be esepanded in rather obvious ways so as to incorporate 
more complex forms of propositional arguments,) > 

I have in the developmental stage a program that will dtiTectly generate ordinary 
English text dire'ctly froiA thrf^ist of ordered propositional components, All- 
told* approximately 30# 000 variations ^are possible. There are first of all the 

JZ basic ^argument formsi next tjiere are 6 different orderings of premises and 
Dnclusionr th^n there are^S different forms for the English conditional* This 
gives 2048 possible formg. Finally* superimposed on these forms are^between 8 
to 12 variations of English premise and conclusion markers (along with expres- 
sions of emphasis); the result is about 30#000 vai;iation3 of English, te:ok. 

T est Format * . * ^ 

The propositional at^gumen^ program can also be ,used in a test ^ well as a 
tutorial fornjat. The test format limits students to single atternpts (though 
the program will allow for the ^correction of **gross'' spelling mistakes before 
grading begins,), A simple correct/incorrect respopse is given. In the case of 
an incorrect ^response* the correct answer is supplied- ^ ^ * 

9K^E^?S3,^ Diagrams 

The program for categorical syllogisms is very similar to that \ised for proposi- 
tional arguments- It ha^# though* the additional feat\ire of offering students 
the capability of using Venn diagrams to determine validity, .Qua si -graphics are 
possible using the normal character set and the Ohio Sitate function CRT routines. 



Tutori al-Test C ombina j:_ions 
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^th] 



ERIC 



ile* as I have already noted* ENIGMA is.now used in a combinationj^ tutorial- 
^est lAode* we are generalizing our managerial-operations system to allow for. 
three general formatss (l) COTibination tutorial-test J (2) exclusively tutorial; 

6 



6 ^ 
(3) exclusively test/ with an^ option for a pre- and post-test mode. 

Data St ored ^ ^ " , 

Because ENIGMA will be used at Ohio State with approximately 1000 student^ per 
quarter/^ weT have opted for an immediate on-line data retrieval syetem. This 
system avoids the usual delays associated with off-line tape systems. Very 
detailed and extcnive data can, of course^ also be stored and sorted off-line. 

The data stored on-line for the propositional 4rguments program is; (1) the ; 

number of problems completed; (2) the overall numeric grade; (3) the corresponding 
' mastery level (these levels are under the control of course instructors); (4). 
{ success scores on the rewrite into logically standard English; (5) raw data on 

logical errors^ separated into categories of premise/conclusion confusibn and 

mistranslation of conditionals; (6) finally, a measure is kept of student entry 
' difficulties/ e,gi^ gross spelling errors, ^ ' * • 
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